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ABSTBACT 

The Stages of Concern (SoC) Questionnaire was 
developed in order to aeasure the attitudes of individuals toward 
innovation. The Concerns Based Adoption Bodel provided the 
theoretical basis for the instruaent. According tc this aodel, 
individuals are first cencerned with theaselves, later with the 
details of the task, and finally with the iafact cf their own 
efforts. Becent longitudinal studies have deaenst rated the validity 
of the SoC Questionnaire; two such studies are described in this 
report. In one study, urban eleaentary school teachers attending a 
workshop coapleted the SoC Questionnaire which aeasured their 
concerns about a new diagnostic reading prograa. In the other study, 
the Southwest Educational Development Lab used a prototype SoC 
Questionnaire to aeasure concerns about their preschool Thinking and 
Seasoning prograa. In both studies, the SoC Questionnaire indicated 
that persons having little experience with innovation had aore 
awareness, infornational and personal concerns than persons with 
greater experience. Those with greater exposure tc innovation had 
aore advanced levels of concerns about collaboration in use of the 
innovation, and about refocusing, or considering sore effective 
alternatives. (Hi) 
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DEVELOPMENT AND VALIDATION OP A CONCERNS QUESTIONNAIRE 



Archie George 

Procedures for Adopting Educational Innovations Project 
Research and Development Center for Teacher Education 
The University of Texas at Austin 



The development and validation of a questionnaire are described. The ques- 
tionnaire elicits information on the concerns of individuals involved in educa- 
tional change. Seven scale scores reflect the individuals 1 concerns about any 
given innovation. Over 500 teachers and professors were involved in the develop- 
ment of the measure. Three separate studies which reflect on the validity of 
the instrument are described. Both the instrument and the variety of techniques 
used to investigate its validity should be of interest to researchers involved 
vifch educational change. 



Previous Research on Concerns 

Fuller (1969) proposed that the concerns of student teachers shift from 
one area to another in a systematic fashion as they progress through teacher 
training. She based this hypothesis on several studies of teacher anxieties 
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(Travers, 1952; Thomson, 1963) and on personal experience with innovative 
teacher education programs (Fuller, Pilgrim, & Freeland, 1967) . 

Fuller noted that preservice teachers' concerns seemed to correspond to 
Maslow's (1954) hierarchy of needs. Early concerns were primarily security 
needs. Later, task-related and self-actualizing needs became more prominent. 
A three-stage model was developed in which Self, Task, and Impact concerns pre- 
dominate sequentially during the teacher training sequence (Fuller, Parsons, & 
Watkins, 1973). 

The developers of the Concerns-Based Adoption Model (Hall, Wallace, & 
Dossett 1973) hypothesized that Fuller's developmental concept of concerns 
could be generalized to the innovation adoption process. The concept of "con- 
cerns" has been described as follows: 

The composite representation of the feelings, preoccupation, 
thought, and consideration given to a particular issue or task 
is called concern » Depending on our personal make-up, knowledge, 
and experiences, each person perceives and mentally contends with 
a given issue differently; thus there are different kinds of con- 
cerns. The issue may be interpreted as an outside threat to one's 
well-being, or it may lie seen as rewarding. There may be an over- 
whelming feeling of confusion and lack of information about what 
"it" is. There may be ruminations about the effects. The demand 
to consider the issue may be self-imposed in the form of a goal 
or objective that we wish to reach, or the pressure that results 
in increased attention to the issue may be external. In response 
to the demand, our minds explore ways, means, potential barriers, 
possible actions, risks, and rewards in relation to the demand. 
All in all, the mental activity composed of questioning, analyzing, 
and re-analyzing, considering alternative actions and reactions, 
and anticipating consequences is coftcern . An aroused state of 
personal feelings and thought about a demand as it is perceived 
is concern. 

In working with individuals involved in change, staff at the 
UTR&D Center have found concerns about the change to be an impor- 
tant dimension of the process. In this research, the generic 
name given to the issue, object, problem, or challenge, the thing 
that is the focus of the concerns, is innovation . The innovation 
and its use provide a frame of reference from which concerns can 
be viewed and described. 

(Hall, George, & Rutherford, 1977, p. 5) 
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According to the Concerns-Based Adoption Model, anytime an individual en- 
counters an innovation, his or her behavior is initially influenced mainly by 
concerns about his- or herself. As these self -concerns become resolved, the 
Individual's concerns shift to focus on the details of the task. Ultimately, 
the individual becomes concerned about the impact of his or her ef for' " and 
strives to optimize his or her effectiveness. 

Development of the SoC Questionnaire 

The Stages of Concern instrument was developed in order to measure the con- 
cerns of individuals about an innovation. Seven Stages of Concern About the 
Innovation had been hypothesized in the Concerns-Based Adoption Model, as are 
listed in Table 1* These seven stages were systematically explored through a 
set of case studies and critiques by researchers and adoption agents. Formal 
instrument development procedures were initiated in December 1973. The goal 
was a quick scoring, pencil and paper questionnaire. Throughout the development 
process, data collection and analyses were planned with two criteria. First, 
indicators of the validity of the measure were continually assessed so that the 
ultimate product would measure the Stages of Concern with as much validity as 
possible. Second, the data were investigated in order to determine whether 
there might be more or fewer than seven Stages of Covern. 

In February 1974, a sample of 300 elementary teachers and college profes- 
sors were asked to express in writing their concerns about innovations being 
adopted at their institutions. All these items were then Q-sorted by ten judges 
according to the SoC definitions. Taking those items that six or more of the 
judges agreed on as being indicative of a particular SoC, a 195-item prototype 
measure using a seven-point Likert scale for each item was developed. 

In April and May 1974, the 195-item prototype measure was completed by a 
sample of elementary school teachers in relation to the innovation of team 

ERIC 5 



Table 1 

Stages of Concern About the Innovation 3 
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teaching and college professors in relation to the innovation of instructional 
Modules, rhe samples were stratified according to years of experience with 
the innovation, ranging from individuals never having used either teaming or 
modules, to those with five or more years of experience. The resultant data 
(N « 366) were then factor analyzed. Ten principal components factors were 
extracted. Three of these factors were unidentifiable because no items had 
primary loadings on them. The other seven factors were 7ARIMAX rotated. 

A cons>arison of the hypothesized scales with the obtained factor structure 

I r 

revealed surprisingly high congruence. Stages of Concern scores calculated by 
summing each person's responses on the items for each scale can be correlated 
with factor scores confuted on tht basis of the VARIMAX rotated factor structure* 
A program developed these correlations, which are summarized in Table 2. This 
matrix shows that VARIMAX factor 7 corresponds to the SoC scale for Stage 0, 
factor 1 corresponds to Stage 1, etc. This analysis led project members to 
infer that the seven scales tapped seven independent constructs which could be 
identified readily with the seven Stages of Concern proposed in the Concerns- 
Based Adoption Model. 

Each item, it should be noted, was responded to on a zero through seven 
scale, a seven response indicating that the person considered that item to be 
"very true of me now" and a zero "not true of me now." Scores were computed by 
adding the responses for the items in each scale; the sum of the scale scores 
constituted the total score. This correlational evidence indicated that the 
items on a particular scale tended to be responded to similarly, the inference 
being that the items in each scale measured a notion distinct from notions 
measured by other scales. 

Teachers and professors with varying amounts of experience with an innova- 
tion, in reflecting about their concerns, "sorted" the items into clusters 
which corresponded to the concern stages without their having known about con- 
cerns theory. Thus, initially at least, the idea of there being identifiable 



Table 2 

Correlations Between VARIMAX Factor Scores and Scale Scores 
or. the Pilot Stages of Concern Questionnaire — 
Analysis of 150 I ten 3, 363 Respondents 
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clusters (factors) of concerns seemed to have a quantitative basis. The 35- 
item Stages of Concern Questionnaire was then constructed by selecting from 
among the strongest items (factor loadings greater than 0.5) representing each 
of the rotated factors. 

Reliability of the SoC Questionnaire 

The items representing each stage on the questionnaire were thus selected 
in such a manner that high internal reliability was very likely. In the Fall 
of 1974, a large sample (N * 830) of teachers and professors expressed their 
concerns about the innovations of team teaching and instructional modules. The 
35-item SoC Questionnaire was used, and item analyses were conducted. Table 3 
shows the alpha coefficients of internal consistency for each of the seven 
Stags of Concern scales. These coefficients reflect the degree of reliability 
among items on a scale in terms of overlapping variance. The formula is a gen- 
eralisation of the Kuder-Richardson Formula 20 for dichotomous items (see 
Cronbach, 1951). Program TESTAT on the VSTAT library was used to compute these 
efficients (Veldman, 1967). 



Table 3 

Coefficients of Internal Reliability for 
the Stages of Concern Questionnaire, N « 830 

Stage 0 1 2 3 4 5 6 

Alphas .64 .78 -83 .75 -76 .82 .71 

A subsanple of 171 teachers were asked to complete the SoC Questionnaire a 
second time* two weeks after their initial completion of the ijistrumentT Most 
of these teachers (N - 132) completed and mailed in this "retest" data. Teat- 
re test correlations were ©input ad and are shown in Table 4. 

Table 4 

Test-Retest Correlations on the 
Stages of Concern Questionnaire, N » 132 , 

Stage 0 1 2 3 4 5 ( 6 

Pearson-r .65 .86 -82 .81 .76 .84 -71 



Validity of the SoC Questionnaire 

These indicators of measurement stability reflect the reliability of the 
scores obtained on the questionnaire. The validity of the scores as measures 
of concerns (as we conceptualize concerns) could not be demonstrated as easily. 
There does not exist another measure of concerns with which we could easily 
oon?>are our measure. Following Cronbach and Meehl (1955), we have endeavored 
to demonstrate that scores on the questionnaire relate to each other to 
other variables exactly as we would expect concerns to be related. Thus, inter- 
correlation matrices, judgments of concerns based on interview data, and con- 
firmation of expected group differences and changes over time have been used 
to investigate the validity of the SoC scores. 

The first indications that the questionnaire did measure, concerns as we 
conceptualize them came with the analyses of the 195-item pilot questionnaire 
(Hay 1974) . This prototype instrument contained six subscales (stage 1 through 
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Stage 6) . Each stage consisted of between 14 and 68 items (which had been 
Q-sorted by the staff into those stages) . Evidence for the validity of these 
stages as separat constructs which were related in a developmental way comes 
from two analyses. On Junb 20, 1974 , an analysis of the data from 359 persons 
who had completed th^i95-item questionnaire indicated that 83% of the items 
correlated more highly with the stage that had been assigned than with the total 
score on the instrument. Indeed, 72% correlated more highly with the stage 
they had been assigned to than with any other stage. 

On June 25 , 1974 , a correlation matrix was computed based on this same data. 
Table 5 shows how the scales (each measuring one stage) intercorrelate. 



Table 5 

Intercorrelation of 195-Item 
Stages of Concern Questionnaire Scale Scores 

Stages 

1 2 3 4 5 



Stages 



1 

2 
3 
4 
5 
6 



1.0 



.68 
1.0 



.47 
.78 
1.0 



.21 
.43 
.60 
1.0 



.21 
.37 
.51 
.82 
1.0 



,19 
.43 
.59 
.80 
.77 
1.0 



The correlations near the diagonal are higher than those mere removed from 
it. Guttman (1954, 1956) has applied the term simplex to this type of pattern. 
The simplex pattern in a matrix corresponds to a set of objects having degrees 
of similarity and dissimilarity with one another in such a way that they can be 
arranged on a line. Each object will be more like an object immediately beside 
it than like any other farther away on the line. Thus, the scales on the pilot 
questionnaire indicated an order consistent with the hypothesized order of the 
Stages of Concern. 



Then, we looked at the 35-item questionnaire data collected in the Fall of 
1974. The scores on each Stage of Concern were converted to percentiles and 
sorted according to highest percentile • A composite Stages of Concern profile 
could be examined which represents the average percentiles on each Stage of 
Concern for all individuals who peaked on a giv^n Stage. These profiles are 
presented in Table 6. As a general rule, the scores on stages adjacent to the 
highest concern are higher '-.han those further removed • This is further evidence 
that the Stages of Concern, as measured by the questionnaire, may be develop- 
mental. 

Table 6 

Average stage of Concern Percentile Scores 
Sorted by Highest Stage of Concern (Fall 1974 data) 

Average Percentile Scores 







0 


1 


2 


3 


4 


5 


6 


Tota 




0 


81 


59 


56 


44 


29 


28 


27 


44 




1 


64 


87 


75 


51 


51 


53 


38 


69 


Hic,h 


2 


63 


80 


89 


62 


52 


52 


44 


75 


SoC 


3 


53 


60 


65 


87 


53 


48 


,- 55 


69 




4 


28 


32 


35 


39 


78 


56 


47 


' 43 




5 


29 


45 


39 


38 


59 


88 


48 


51 




6 


42 


51 


52 


44 


68 


58 


85 


64 



A rigorous validity study was conducted in August and September 1976. The 
research focus in this effort was expressed as follows: How accurate are in- 
ferences about a person's concerns about an innovation likely to be when these 
inferences are based on the SoC Questionnaire data? In order to answer this 
question, st^ff members first assessed a person's concerns by listening to taped 
interviews. Each person's concerns were estimated, then the actual SoC scores 
were examined. This procedure enabled the investigators to provide quantitative 
ratings on the person's concerns prior to exposure to SoC scores. Pilot studies 
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had shown that when the investigator is exposed to SoC scores prior to assessing 
concerns in soma other manner, a typical reaction had been that the scores did 
reflect the person's concerns, but these scores may have been misinterpreted. 
It was then impossible ta assign quantitative concerns scores on the basis of 
the alternate measure without bias due to exposure to the SoC scores. 

The analyses reported here deal with the following quantitative data: 
,1. Investigators 1 ratings of SoC based on a taped interview. The highest 

perceived concern was indicated along with one or two "also high" concerns. 

/ 

The remaining four or five stages were, by implication, of lower concern. 

2. \- A self-report rating of the difficulty the investigator had in assessing 

these concerns from the ~cU .nterview. 

3. Subjective rating of "to wh t extent does the profile reflect your assess- 
ment of the person?" 

4. Subjective rating of "how adequately does the high stage score on the pro- 
file reflect the person's concerns?" 

5. SoC raw stage scores (7 plus total). 

6. SoC percentile stage scores (7 plus total). 

Three staff members provided data on 28 persons selected at random from a 
group of several hundred teachers who completed the SoC Questionnaire in the 
Spring of 1976. 

The first analysis investigated the reliability of the investigator's 
ratings of concerns, difficulty, and assessments of profile and high score accu- 
racy. In general, relinbili ties were moderate to high. (See Table 7.) Ratings 
of the "highest" and "also high" concerns showed group reliabilities between .42 
and .85. Six of the seven were above .58 (p < .01). Only Stage 3 showed a 
nonsignificant reliability (.42, p = .06). These were very encouraging findings, 
because pilot attempts at assessing concerns from interviews 'had provided less 
reliable data. 

12 
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Table 7 

Reliability of Ratings in Validity Study Analysis 
Variable Reliability 



Ratings of SoC Based on 
Interview Data: 

Stage 0 

Stage 1 

Stage 2 

Stage 3 

Stage 4 

Stage 5 

Stage 6 

Rating Difficulty 

Satisfaction with Congruence 
of Estimated and Obtained SoC 

Satisfaction with Highest SoC 

as Sole Representation of Corjerns 
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<.01 
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Ratings of the difficulty of assigning SoC scores on the basis of the 
interview were less reliable (.37 f p = .10). This rating and the rating of the 
congruence of the SoC scores and perceived concerns (.27, p = .18) were rated 
differently by the three investigators on these persons. Assessment of congru- 
ence may be unreliable simply because the investigatovs had varying degrees of 
satisfaction over the accuracy of the SoC profile. 

Assessed degree of satisfaction with the high score ci representative of 
the persons' concerns was the least reliable datum (.09 f p * .39). 

Table 8 shows the correlations between the investigators' ratings and the 
rank ordering of the SoC percentile scores. Ideally, high diagonal correlations 
would be obtained. Indications are that Stage 5 is the "cleanest" (r » .54). 
Stages 1 and 2 show high diagonal correlations, but also correlate with eat 
other off ti*? diagonal. Stages 0, 3 f and 6 are marginally clean, while Stage '4 
failed to correlate on the diagonal at all (r * .13). Six out of seven 
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Table 8 
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significant correlations on the diagonal was very encouraging. Only 11 of the 
42 off-diagonal elements were significant, and half of these significant cor- 
relations were negative (5/11). It can be concluded that, except for Stage 4, 
validity of the SoC is supported in this matrix. 

Perhaps the most convincing demonstrations of the validity of the Stages 
of Concern Questionnaire have come in the course of its use over the last two 
years in longitudinal studies. Two cases in which the SoC scores dramatically 
reflected changes in concerns which had been predicted by the concerns theory 

are presented here. 

The faculties of two elementary schools in an urban school district were 
invited to participate in a summer workshop where they would help develop and 
learn how to use a new approach to reading instruction. The new approach, which 
was to replace a traditional Basai reader program, might best be described as 
a diagnostic-prescriptive program. It called for teachers to begin by assessing 
student needs, followed by the establishment of specific instructional objec- 
tives, appropriate instruction, and finally careful evaluation of pupil mastery 

14 
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of the stated objective. Although the new approach continued to utilize Basal 
readers, they were used, or supposedly used, in very different ways. In fact, 
the new program required a very different way of teaching reading. 

As it turned out, approximately h=*lf (N * 22) of the faculty members were 
able (and willing) to attend the five-week summer workshop. To accommodate 
those who were not in the workshop (N * 25), a one-^day workshop was set up just 
prior to the opening of school in the fall to explain the new program and its 
implications for them. On that same day in a separate location, the workshop 
participants were meeting for a different purpose. AS the first activity of 
the day, both groups were asked to complete the Stages of Concern* Questionnaire 
which measured their concerns about the new reading program. SoC profiles are 
shown in Figure 1. 

Persons who had not attended the worksljpp Indicated higher concerns on 
Stages 0, 1, 2, and 4 (p < .01 in each comparison). There were no significant 
differences between the groups on Stages 3, 5, and 6. Assuming that the 
groups were the same except for workshop attendance, it can be inferred that 
the workshop lowered the teachers' Awareness, Informational, and Personal con- 
cerns (Stages 0, 1, and 2). In addition, concerns about the effects of the in- 
novation on students (Stage 4) were lowered by the workshop. We would expect 
that concerns about Collaboration and Refocusing (Stages 5 and 6) would in- 
crease after the teachers had some experience using the innovation. No follow- 
up data was collected, however. 

In another study, the Southwest Educational Developmefit Lab used a proto- 
type concerns questionnaire to measure concerns about their preschool Thinking 
and Reasoning program. Preworkfehop, Postworkshop, and Follow-up concerns as- 
sessments revealed the type of shift in concerns illustrated in Figure 2. 
Scores on the lower stages (0, 1, 2, and 3) dropped with eaCh assessment. 
Scores on the higher stages (5 and 6} rose with each assessment. Scores on 




Figure 1 

Concerns Profiles for Workshop and Nonworkshop Groups 
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Figure 2 

Concerns About a Preschool Thinking and Reasoning Program 
Assessed at Three Points in Time 
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Stage 4 were highest before the workshop, lowest after the workshop, and at an 

intermediate level on follow-up. 

In each of these studies, the SoC Questionnaire indicated that persons with 

little experience with an innovation had more Awareness, Informational, and 

Personal concerns than persons with greater experience. The SoC Questionnaire 

also indicated that persons with, some experience with an innovation had higher 

concerns about Collaboration and Refocusing than tliose without experience. 

Concerns about Management and Consequence of the innovation were not as related 

to experience as the other stages. These findings indicate that the Stages of 

Concern Questionnaire very probably is measuring concerns about the innovation 

i 

as we have defined them* 

Summary and Conclusions 

The Concerns-Based Adoption Model was developed to explain the innovation 
adoption process. The concept of concerns of teachers, as developed by 
Frances Fuller, was applied to the concerns cf teachers about educational change 
Seven Stages of Concern were hypothesized. A psychometric questionnaire was 
developed to measure these seven concerns. The data presented here have led 
researchers at the Research and Development Center for Teacher Education to feel 
confident that the Stages of Concern Questionnaire is a reliable and, valid 
measure of these concerns of teachers. The instrument should prove to be a 
valuable tool in the >study of educational change. Administrative personnel 
should also find the SoCQ to be useful in facilitating change. 
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